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Abstract. One of the simplest matrix-valued function with a single variable matrix X is given by A + BXC. In 
this this note, analytical formulas are established for calculating the maximal and minimal ranks of A + BXC when 
the rank of the variable matrix X is fixed by using a simultaneous decomposition of A, B and C and some prelimi- 
nary results. Some applications of the formulas in completing partially-specified block matrix with the maximal and 
minimal ranks are also given. 
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'. 1 Introduction 

i— » 

\q [ Fixed-rank or low-rank matrix approximation problems are to approximate optimally, with respect to some 

criteria, a matrix by one of the same dimension but fixed or smaller rank from a given feasible matrix 
set. Assume that A is a matrix to be approximated. Then a conventional statement of general matrix 
' ■ optimization problems of A from this point of view can be written as 

, minimize p( A — X ) subject to X e S, (1-1) 



cn 

o 



where p(-) is a certain objective function of decision matrix, which is usually taken as determinant, trace, 
norms, rank, inertia of a matrix, and S is a certain feasible matrix set. A best-known case of (11.11) is to 
minimize the norm || A — X \\p subject to X £ S. The fixed-rank or low-rank matrix set mentioned above 
can be written as 



> . S = {X rank(A) =t} or S — {X | rank(A) < t}. (1.2) 

in 

The use of low-rank matrix to approximate a given matrix dates back to [2 [6] , which now becomes a very 
active research subject in both optimization theory and applied disciplines. 

Although these problems are stated quite clearly in form, it is hard in general to give satisfactory answers 
in closed-form to these matrix approximation problems. In other words, only numerical solutions to these 
approximation problems can be obtained. In this note, we assume that the objective function p(-) in (|1.1|) 
is taken as the rank of matrix. Then this kind of optimization problems can generally be written as 



maximize rank( A — X ) subject to Ie5, (1-3) 
minimize rank( A — X ) subject to X e S, (1-4) 

respectively. The rank of matrix, as an objective function, is often used when finding feasible matrix X such 
that resulting A—X attains its maximal possible rank (is nonsingular when square), or such that A—X attains 
the minimal rank as possible (called low-rank matrix completion). This kind of problems are usually called 
the matrix rank-maximization and rank-minimization problems, or matrix rank completion problems in the 
literature. Generally speaking, matrix rank-optimization problems are a class of discontinuous optimization 
problems, in which the decision variables are matrices running over certain matrix sets, while the ranks 
of the variable matrices are taken as integer-valued objective functions. In this case, analytical formulas 
for calculating the integer extremum ranks of A — X can hardly be derived by numerical approximation 
methods. This fact means that solving methods of matrix rank optimization problems are not consistent 
with any of the ordinary continuous and discrete problems in optimization theory, so that we cannot apply 
various common methods of solving continuous optimization problems, such as the well-known differential 
and Lagrangian methods, to approach these constrained optimization problems. Instead, we can only find 
the exact maximal and minimal ranks through pure algebraic operations of matrices. It has been known 
that matrix rank-optimization problems are NP-hard in general due to the discontinuity and combinational 
nature of rank of a matrix and the algebraic structure of S. Many new researches were conducted on this 
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kind of matrix rank-optimization problems from theory and applied points of view in the past decades; see, 
e.g., {5.. Because the rank of a matrix can only take finite integers between and the dimensions of the 
matrix, it is really expected to establish certain analytical formulas for calculating the maximal and minimal 
ranks for curiosity. 

In what follows, we assume that A G C TOXn , B G c«»xp anc i q g C 9X ™ are given matrices, and the 
feasible matrix set S in Ijl.ljl is taken as 

S = {-BXC | X G C pxq and rank(X) = t}. (1.5) 

Then, the difference in can equivalently be written as the following linear matrix- valued function 

(j){X) = A + BXC, (1.6) 

which is a map 4> : C pxq —> C mx ". Under such a formulation, this note aims at solving the following 
constrained matrix optimization problems: 

Problem 1.1 For the function in (|1.6p and two integers s and t with ^ s ^ t ^ mm{p, q}, establish 
explicit formulas for calculating the following extremal ranks 

(1.7) 
(1.8) 
(1.9) 
(1.10) 

The matrices X satisfying the constraints in (jl.7j) - (|1.10j) are called the feasible solutions (i.e., candidates 
for solutions) to the problems, respectively. They form certain sets of <C pxq and it is over these sets that the 
objective function is to be maximized or minimized. However, these matrix sets are not necessarily convex. 
Motivations for finding the extremal ranks of (| 1 .€>[) arise from both theoretical and applied points of view. It 
is really lucky that we can establish analytical formulas for calculating the extremal ranks of matrix- valued 
functions for some special matrix sets S by using various expansion formulas for ranks of matrices and some 
tricky matrix operations. For instance, two well-known seminal formulas in closed-form for calculating the 
global maximal and minimal ranks of (jl.6l) are given by 



maximize rank( A - 


>rBXC) 


s.t. 


X e C pxq 


and 


rank(X) = t, 


minimize rank( A - 


-BXC) 


S.t. 


X e C pxq 


and 


rank(X) = t, 


maximize rank( A - 


^BXC) 


s.t. 


X G C pxq 


and 


s < rank(X) < t, 


minimize rank( A - 


-BXC) 


s.t. 


X G C pxq 


and 


s < rank(X) < t. 



max rank( A + BXC ) = min < rankf A, B 1 , rank 



min rank( A + BXC ) = rankf A, B 1 + rank 



.4 
C 



A 
C 



— rank 



A B 
C 



(1.11) 
(1.12) 



Because the right-hand sides of (jl.lll) and (I1.12[) are calculated only by three block matrices composed by 
the three given matrices, a beginner who knows the concept of matrix rank in linear algebra can understand 
the usefulness of (jl.lip and (|1.12l) . People can apply (ll.ll[) and (|1.12[) to characterize many fundamental 
behaviors of A + BXC, for instance, necessary and sufficient conditions can directly be established for 
A + BXC to be nonsingular; for A + BXC to be zero; for the rank of A + BXC to be invariant under 
different choice of X; for the row and column spaces of A + BXC to be invariant under different choice of X, 
respectively, etc. However, these two elementary formulas cannot be proved within the scope of elementary 
linear algebra. Some people made essential contributions for the establishments of (jl.lip and (|1.12p through 
pure algebraic operations of the given matrices and generalized inverses, as well as simultaneous matrix 
decompositions of the given matrices; see, e.g., [TJ HJ [51 IH] . Analytical expressions for the general expressions 
of the variable matrices X satisfying (II. lip and (|1.12p were also obtained through generalized inverses and 
simultaneous matrix decompositions of the given matrices in [U [9]. Eqs. (jl.lll) and (|1.12p are not just two 
isolated formulas for the maximal and minimal ranks of matrix-valued functions. Motivated by some recent 
work on low-rank matrix approximations, the present author revisits (|1.6p by adding certain rank restrictions 
on the variable matrix X, and establishes some new and elementary formulas for calculating the maximal 
and minimal ranks in (jl.7p - (jl.lOI) . which, we believe, can be taken as some standard examples for verifying 
accuracy of various algorithms in solving matrix rank-approximation problems. 

Throughout this note, C mx ™ stands for the set of all m x n complex matrices; <C™ X " stands for the set of 
all to x n complex matrices with rank(X) = t; A*, r{A) and £%{A) stand for the conjugate transpose, rank 
and range (column space) of a matrix A G C mx ™, respectively; I m denotes the identity matrix of order m; 
[A, B] denotes a row block matrix consisting of A and B. 
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In dealing with problems in the formats of (|1.7|) - (jl.l0p . people usually construct certain canonical forms 
of the matrix- valued functions through some simultaneous decompositions of A, B and C, because the ranks 
of matrices are invariant under nonsingular matrix transformations. In order to establish a canonical form 
of (|1.6j) . we need the following several known or simple results on simultaneous decompositions of matrices 
and rank formulas for block matrices. 



Lemma 1.2 ([10, llj) Let A G 

matrices P G C mxm , Q G C 1 



, B G C mxp and C G C qxn . Then there exist two nonsingular 

(1.13) 



and two unitary matrices U G <C pxp , V G C qxq such that 
A = PE A Q, B = PZ B U, C = ViZ c Q, 



whe 
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(1.14) 
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(1.15) 



(1.16) 



Sa, Sb and Sc are diagonal matrices with positive diagonal entries, and 

j = r n + r(B) - r 

/-=/• J , -r(B)-r(C), 



A B 
C 



l = r[A, B}+r(C)-r 
r(A)- 



si 



A B 
C 

'A 

C 



A B 
C 

.4 
C 



r[A, B], 



r(A), 



Lemma 1.3 Let X G C ( 

Then, 



s 2 = r[A, B] — r(A), 
t\=n — r g 
t 2 = m - r[A, B). 
Y G C mxp and Z G <C qxn be three variable matrices, and let 



<P(X, Y, Z) 



X Y 
Z 



max r\(f>(X, Y, Z )] = min{ m + q, n + p, 



+ n}, 



mm r 



[cb(X, Y, Z)}=0. 



(1.17) 

(1.18) 
(1.19) 



Further, for any integer t with t min{ m + q, n + p, m + n }, £/iere exist X G C mXn , F £ C raxj ' and 
Z G C qxn such that 



X Y 
Z 



= t. 



(1.20) 



Proof. It is obvious that the right-hand side of (|1.18[) is an upper bound of r[cf)(X, Y, Z)}. 

(I) Under to + q ^ min{ n + p, m + n } and m ^ p, setting 

X = 0, Y=[I m , 0], Z=[I q , 0] 
leads to r [<fi(X, Y, Z )] = r(Y) + r(Z) = m + q; under m + q ^ min{ n + p, to + n } and m > p, setting 

[X, F] = [0, I m ], Z=[I q , 0] 

leads to r[<f)(X, F, Z)]=m + q; 

(II) under n + p ^ min{ m + q, m + n } and n ^ q, setting 

X = 0, F=[I n , 0] T , Z=[/ p , 0] T 
leads to r[(f>(X, Y, Z )] = r(F) + r(Z) = rt + p; under n + p ^ min{ m + q, m + n } and n > q, setting 





' X ' 




' " 


, Y = 


' V 




Z 









leads to r[<j)(X, Y, Z)]= r{Y) + r{Z) = 


n + 


P- 









(III) under m + n ^ min{ to + q, n + p }, setting 

X = 0, F = [J m , 0], Z=[7„, 0] T 

leads to r[(f>(X, Y, Z)] = r(Y) + r(Z) = m + n; establishing ([TT5]) . 
Setting X = and Y = leads to ([135]) , 

(a) for any integer i min{ m + q, n + p, m + n} with to + q ^ min{ n + p, m + n} and m ^ p, 
setting 

X = 0, F=[y!, 0], Z=[Z 1 ,Q], r{Y 1 )+r{Z 1 ) = t 
leads to r[<fi(X, Y, Z )] = r(Yi) + r(Z\) = t; with to + q ^ min{ n + p, m + rt } and m > p, setting 

[X,Y] = [0,Y 1 ], Z=[Z 1} 0], r(Y 1 )+r(Z 1 ) = t 

leads to r[<f>(X, Y, Z)]= r(F x ) + r(Z x ) = t; 

(b) for any integer ^5 t min{ to + q, n + p, to + n } with n + p ^ min{ to + q, m + n } and n ^ q, 
setting 

X = 0, F = [Fi, 0] T , Z-[Zi, 0] T , r{Y 1 )+r{Z 1 )=t 



leads to r[</>(JT, Y, Z )] = r{Y\) + r(Z\) = t; with rt + p ^ min{ to + q, to + ?i } and n > q, setting 

F 



z 





Zl 



Fi 




leads to r[</>(X, Y, Z)]= r(F x ) + r(2 x ) = t; 

(c) for any integer ^ t ^ min{ m + q, n + p, to + n } with m + n ^ min{ to + q, n + p }, setting 

X = 0, F = [F l5 0], Z = [Zi, 0] T , r(Ti)+r(Zi) = t 

leads to r[<j>(X, Y, Z )] = r(Fi) + r(Zi) = t, establishing (fl~20f . □ 

Lemma 1.4 Lei A G C mxn fee qiven, F G C mxp , Z G C ?x ™ and U G C <?xp fee i/iree variable matrices, and 
define 



<KY, Z, U) 



A Y 

z u 



(1.21) 
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Then, 



max r\d>(X, Y, {7)1 = mini m + p, n + q, p + q — r(A) }, 

min r[<A(A, Y, C7")] = r(A). 

Yec mx *>, zeci xn , uecixv 



(1.22) 
(1.23) 



In particular, for any integer t with r(A) ^ t ^ min{ to + p, n+ q, r(A) + p + q}, there exist Y G C mxp , 
Z e C 9Xn and E7 G C 9><p sucft iAoi 



r[<f>(X, Y, U)] = t. 

Proof. Without lost generality, we assume that A is given by 

A = diag(/ d , 0). 



Correspondingly, 



4>(X, z, U) 



Id Yt 
Y 2 
Zi Z 2 U 



(1.24) 
(1.25) 

(1.26) 



and 



Y 2 
Z 2 U - Z X Y X 



(1.27) 



r[(j>(Y, Z, U)] = d + r 
Applying ()1 . 18[) and (|1.19|) to the block matrix in (|1.27|) leads to 

= mia{m + p - r(A), n + q — r(A), p + q — 2r(A)}, (1.28) 

= 0. (1.29) 



max r 

Yec mx p, zeci*™, ueci x p 



Y 2 
Z 2 U- Z x % 



mm r 

Y£C mx p,zeCi xri , ueC qXp 



Y 2 
Z 2 U- Zi% 



Substituting (|i~28)) and (|1~29|) into (fl~27|) yields (H~22)) and ([L23]) . Applying (fl~20| to (fl~28l) and (fl~29| leads 
to (Ti~2"4|) . □ 

2 Rank optimization of ^4 + X 

One of the special cases in (jl.6|) is the ordinary sum A + X . In this section, we derive explicit formulas for 
calculating the extremal ranks of A + X subject to X with a fixed rank. The formulas obtained will be used 
in Sections 3. 

Theorem 2.1 Let A G C mx " be given, X G c«>xn fr e a variable matrix, and assume that s and t are two 
integers satisfying 



^ s ^ t ^ min{ to, n }. 



TTien, 

(a) TTie following equalities hold 



max r( A + A ) = min{ m, n, r(A)+t}, 
min r(A + X) = \r(A) -t\. 



xei 



(b) The following equalities hold 



max r( A + A ) = mini m, n, r(A)+t\, 
min r(A + X) = max{ 0, s-r(A), r(A) - £}. 



(2.1) 

(2.2) 
(2.3) 

(2.4) 
(2.5) 



5 



(c) The following equalities hold 



max r( A + X ) = mini to, n, r(A)+t}, (2-6) 

XeC mxn ,0^r(X)^t 

min r(A + X) = max{ 0, r(A)-t\. (2.7) 

XeC"' x ",0^r(X)^t 



(d) TTie following equalities hold 

max r( ^4 + X ) = min{m, n}, (2-8) 

XeC rax ™,ssJr(X)<min{m,ii} 

min r(A + X) =max{0, s-r(A)}. (2.9) 

XeC™*",s^r(X)sSmin{m,rl} 

T/ie matrices X satisfying these equalities can be formulated from the canonical form of A. 

Proof. It is obvious that the right-hand sides of (I2.2[) and (|2.3I) are upper and lower bounds. Without loss 
of generality, we assume that A is of the form 



A = diag(7 d , 0). (2.10) 

r n n 1 

Let X = 




I t 

r( A + X ) = n; if r(A) + t < min{ to, n }, then r(A + X) = r(A) + t, so that (j2~2"j) holds 

-Jd 
I t -d o 




If r(A) < t, then setting X = 

X -- 



If to ^ min{ n, r{A) + t }, then r( A + X ) = to; if n min{ to, J"(j4) + i }, then 

X ) = r(A) + t, so that (g^ holds. 

gives r(A + X) = t — d; if r(A) > t, then setting 



-It 

Note that 



gives r(A + X) = d-t, so that (|2~3]) holds. 

{X G C mxn | s < r(X) < t} = C" s ixn U C™*™ U . . . U q" 



So that 



max r(A + X) =ma,xi max r(i + I), max r( A + X), . . . , max r(4 + I) , (2.11) 

xec™x«,s<r(X)« [xec? 1 *" xeC+r x e cr x ™ J 

min r(A + ) =min< min r(A + X), min r{A + X),..., min r(A + X)>. (2.12) 

xec™x",ss:r(x)«:t [xeCT xri xeC™^ xec t rox " j 

Substituting ([2~2]l and ([2~3]) for r(X) = s, s + 1, . . . , t into (|2~TT|) and (|2~T2|) and making the max-min 
comparison, we obtain 

max r(A + X) 

XeC mx ™, s^r(X)^t 

= max {min{ to, n, r(A) + s }, min{ to, n, r(A) + s + 1 }, . . . , min{ m, n, r{A) + t}} 

= min{TO, n, r(A)+t}, (2-13) 
min r( A + X ) 

= min{|r(A) - s |, | r(A) - s- 1|, | r(A) -t\} = max{0, s - r(A), r(A) - t}, (2.14) 

establishing and ([13]), as well as ~^M- D 

The results in the section show that the matrix rank optimization formulated in (| 1 . T[) ()1 . 10[) arc combi- 
natorial in nature. 

3 Rank optimization of A + BXC 

A matrix- valued function for complex matrices is a map between matrix spaces C mx ™ and C pxq , which can 
generally be written as 

Y = f{X) for Y G C mx ™ and X G C pxq , 



G 



or briefly, / : C mxn — > C pxq . Eq. (|1.6p is in fact the simplest case of all matrix-valued functions, which is 
extensively studied from theoretical and applied points of view. 
According to [10], substituting (|1.13j) into (jl.6l) yields 



<f>(X) = P^aQ + PZbUXV^cQ = P{ £4 + ^bUXV^c )Q, 



(3.1) 



which we call a canonical form of (11.61) . Many properties of the matrix- valued function A + BXC can be 
derived from the canonical form. For instance, the rank of A + BXC is 



r(A + MC)=r(S A + E B rS c ), r(X)=r(Y), 
where Y = UXV. Partition it as 



Y = 



Y u 


Y 12 


Y 13 


Y u 
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Y21 


Y22 


Y23 


Y24 


P~ 


Y 31 


Y32 


Y33 


Y M 
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Yu 


Y42 


Y43 


Y 44 _ 


S2 


u — 


ai I 
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Sl 





(3.2) 



(3.3) 



Then we have 
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Y 12 


Y 13 S C 


Y u 
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SBY32 


Sa + SbY 33 Sc 


S B Y M 











Y42 


Y i3 S c 


F44 
























and 



r(S y 



S B rS c ) = j + k + l + r 
= r[A, B]+r 



Sa + SbY 33 Sc SbY 34: 





Y i3 


Sc 




F 44 


' A ' 




' A 


B ' 




C 


— r 


C 





+ r 



S B SaS c + Y33 Y34 



Y 43 



Y u 



So that 



max r(E A + Z B YY, C ) = r[A, B] +r 
min r(Z A + Z B YY,c) = r[A, B]+r 

y eC PX 9 



" A ' 




' A 


B ' 


C 


— r 


C 





' A ' 




' A 


B ' 


C 


— r 


C 






+ max r(S + Y), 

Yec p t xq 

+ min r(S + Y), 

y eC PX<j 



where 



5': 







Y 



Y 33 I34 

Y i3 y 44 



(3.4) 



(3.5) 

(3.6) 
(3.7) 



Applying Theorem 12.1T b) to (|3.6[) and (J37TJ) yields the main result in the note. 

Theorem 3.1 Let 4>(X) be as given in (|1.6[) . and assume that t is an integer satisfying ^ t ^ min{p, q }. 
Also define 



G=\A,Bl H = 



' A ' 


, M = 


' A 


B ' 


C 


C 






Then, 



max r( A + BXC ) = min <r[A, B] r 

xeC- xq 



A 

C 



r(A)+t 



(3.8) 



(3.9) 



min r( A + BXC ) = max ir[A, B] - r 



' A ' 




' A 


B ' 


C 


— T 


C 






r[A, B]+r 



A 
C 



r(A)+t-p-q, r(A)-t 
(3.10) 



In consequences, 
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(a) Under m = n, there exists an X S Cf xq such that A + BXC is nonsingular if and only if 

r{G)=r{H)=m and r(A)^m-t. (3.11) 

(b) There exists an X € Cf xq such that A + BXC = if and only if 

M(A)C^(B), M{A*) C M(C*), r{G) + r{H) sC r(A) - t + p + q, r(A) sC t. (3.12) 

(c) Under t ^ 0, the rank of A + BXC is invariant for all X £ <C^ xq if and only if one of the following 
conditions holds: 

(i) r(M) = r(G), 

(ii) r(M) = r(H), 

(iii) r(M) = r(G) + f(H) - r(A) - t, 

(iv) r(G) = r( J 4) + 

(v) r(-ff) =r(A)+p + q-< ; 

(vi) r(G) + r(H) = 2r(A) + p + q, namely, r(B) = p, r(C) = q, M(A) n @(B) = {0} and M{A*) n 
&(C*) = {0}. 

(d) [/nder^(A) C M(B) and M{A*) C ^(C*), 

max r(i + MC) = min {r(-B), r(C), r(A)+t}, (3.13) 

xec v t xq 

min r( ^ + BXC ) = max {0, r(B) + r(C) - r(A) +t-p-q, r(A) - t} . (3.14) 

xec PXq 

Proof. Let z = p + q - 2r{M) + r{G) + r(H). Then we find by (fl~2"4]l . ([2^4]) and ([23]) that 
max r(5' + l r )= max r( 5* + Y ) = min{ u + si, u + S2, r (<5')+^} 

YeC PXq t-z^r(Y)^t 

= mxa{r(M) -r(G), r(M)-r(H), r(M) + r(A) - r(G) - r{H) + 1} , (3.15) 
min r(S + Y) = min r( 5* + Y ) = max{ 0, t — z — r(S), r(S) — t} 

= max{0, t-p-q + r(M)-r(A), r(M) + r(A) - r(G) - r(H) - t} . (3.16) 

Substituting (|37T5|) and (|3~16l) into dSS]) and (|3J]) yields (ULU) and (|3~T0l) . Setting dHU) equal to m yields 
(f3~TTj) : setting (|3~10| equal to yields (f3TT2]) : setting (|3J]l equal to ff3TT0|) yields the results in (c). □ 

Eqs. p.9p and (|3.10p show that the extremal ranks of ()1.6j) can be calculated exactly from the two 
formulas without knowing how to choose the feasible matrices X. So that they can be used independently 
in describing behaviors of A + BXC, as shown in Theorem 13. lf aWd). 

Recall that any matrix X e C^ xq can be written as a product X = YZ, where G Cj X * and Z S C^* 9 
with r(Y) = r(Z) = t. So that (|3.9j) and (|3.10|) can be represented as follows. 

Corollary 3.2 Let 4>{X) be as given in (|1.6[) . t &e an integer satisfying ^ < ^ min{p, g }, and G, H and 
M be the matrices in (13.81). Then, 



max r(A + BY ZC ) = min {r(G), r(H), r(A) + t} , (3.17) 

Ye<c PX \zeC txq 

min r(A + BY ZC ) = max {r(G) + r(H) - r(M), r(G) + r(H) - r(A) + 1 - p - q, r(A) - t} . 

Yec PX \zec 1 t xq 

(3.18) 

Corollary 3.3 Let <fi(X) be as given in (|1.6I) . G, H and M be the matrices in (|3.8[) . and assume that s and 
t are two integers satisfying 

s ^ t ^ min{p, q}. (3.19) 

Then, 

max r(A + BXC ) = min {r(G), r(H), r(A)+t}, (3.20) 
min r( A + BXC ) = min{u s , u s+ i, . . . ,ut}, (3-21) 

X£Cp x i, s^r(X)^t 
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where 

ui = max {r(G) +r(H) - r(M), r(G) + r{H) - r(A) + I - p - q, r(A) - 1} , I = s, s + 1, . . . , i. 
Corollary 3.4 Let A £ C mxr \ B £ C mxp and C 6 C px ™ &e given. T/ien, 



max r(A + BXC) = mini r[A, B], r 
min r ( A + BXC ) = max { r[ A, B] + r 



A 

C 



' A ' 




' A 


B ' 


C 


— r 


C 






r[A, B]+r 



A 
C 



(3.22) 
r{A)-p\. (3.23) 



Corollary 3.5 Let ^ B G C mxp and =/= C £ C qxn be given, and assume that t is an integer satisfying 
1 ^ t ^ min{p, q}. Then, 



max r( BXC ) = min \r(B), r(C), t\ , 

min r(MC) = max{0, r(B) + r(C) + 1 - p - q\ . 

X£CPXi,r(X)=t 



(3.24) 
(3.25) 



In consequences, 

(i) Under m — n, there exists an X £ C pxq with r(X) = t such that BXC is nonsingular if and only if 

r(B) = r(C) = m and t ^ m. (3.26) 

(ii) There exists an X £ <C pxq with r{X) — t such that BXC — if and only if 

r(B)+r(C) Kp + q-t. (3.27) 

(iii) The rank of BXC is invariant for all X £ C pxq with r(X) = t if and only if 

r(B)=p + q-t, or r(C)=p + q-t, or r(B) = p and r(C) = q. (3.28) 

4 Completing a partially-specified block matrix with extremal 
ranks 

As an application of the results in the previous section, we consider the rank of the following partially 
specified block matrix 



4>(X) 



' A 


B ' 




' A 


B ' 




' " 


C 


X 




C 





+ 


J*. 



X[0, /„], 



(4.1) 



where A £ C mxn , B £ C mxp and C £ C qxn are given, and X £ C qxp is a variable matrix, which obviously 
is a special case of f| 1 . 6[) . Conversely, the rank of ()1.6j) can equivalently be written as 



r(A + BXC) =r 



ABO 

C I a 



p-q, 



I p X 

the block matrix in which is a special case of (|4.1j) as well. 

Theorem 4.1 Let 4>{X) be as given in (|4.1j) . and assume that s and t are two integers satisfying 

^ s ^ t min{ p, q}. 

Also define 

G=[A,B], H = 



' A ' 


, M = 


' A 


B ' 


C 


C 






(4.2) 



(4.3) 



Then, 



(a) The following equalities hold 



max r[<p{X)] = min {r(G) + q, r(H) + p, r(M) + t} . 

xec q t xp 



(4.4) 



min r[<f>(X)] = max {r(G) + r{H) - r(A), r{G) + r(H) - r(M) + t, r(M) - t} . (4.5) 

xec q t xp 

In consequence, 

(i) Under rn + q = n + p, there exists an X G Cj Xp such that <f){X) is nonsingular if and only if 
r(G) = m, r(H) = n and r{M) m + q — t. 

(ii) Underm+q = n+p, 4>(X) is nonsingular for all X £ Cj Xp if and only ifr(G)+r(H)—r(A) = m+q 
or r(G) + r{H) — r(M) = m + q — t, or r(M) = m + q and t = 0. 



(b) Under ^(B) C <%{A) and &(C*) C M(A*), the following equalities hold 

max r[<fi(X)] = min{r(yl) + q, r(A)+p, r(M)+t}, 

xec qxp 

min rWX)} = max{r(A), 2r(A) - r(M) +t, r(M) - t) . 



(4.6) 
(4.7) 



(c) Under ^(A) C @{B) and &(A*) C M(C*), the following equalities hold 

max r[<f>{X)} = min{r(B) + q, r(C) + p, r(B) + r(C) + 1} , 

xec q t xp 

min r[<f>(X)} = max{r(B) + r(C) - r(A), t, r{B) + r(C) - t} . 

xeC t xp 



(4.8) 
(4.9) 



(d) The following equalities hold 

max r\4>(X)] = min {r(G) + q, r(H) + p, r(M) + t} , 
min r[<j>{X)\ = min{u S) . . . , w t }, 

w/iere 

ui = max {r(G) + r(H) — r(A), r(G) + r(H) - r(M) + I, r(A) - 1} , l = s,s + l,. 
Theorem 4.2 Let 

where A, B, C, D £ C mxn . Also define 

G = [A — C, B — D], H 
Then the following equalities hold 



A 


- X 


B 


-X' 




' A 


B ' 




Ira 


C 


- X 


D 


-X 




C 


D 




J-7n 



A-B 
C-D 



M 



X[I n , I n ], 



A B 
C D 



(4.10) 
(4.11) 



(4.12) 



(4.13) 



(4.14) 



max r[(j){X)] = min {r(G) + m, r{H) + n, r(M) + t} , 

A"ec" ix " 

min r[<j>{X)\ = max{r(G) + r(H) - r(A - B - C + D), r(G) + r(H) - r{M) + t, r(M)-t}. (4.15) 



Because the right-hand sides of (|4.4I) . (|4.5p . (|4.14l) and (|4.15[) can be calculated exactly, these results can 
be taken as test examples in fixed-rank or lower-rank approximation and perturbation analysis of matrices. 
They can also be used to verify the correctness the effectiveness of various numerical algorithms in rank 
minimization problems occurred in recent years. 
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5 Concluding remarks 



Closed- form formulas are established for calculating the extremal ranks in (|1.7[> - (|1.10[) . This work shows 
a surprising fact that many matrix rank optimization problems do exist analytical solutions for calculating 
the extremal ranks. 

Besides (|1.7|) - (|1.10[) . a more popular problem is to minimize the norm of (|1.6|) subject to low-rank 
constraint 

minimize || A + BXC \\ F s.t. XeC pxq and r(X)^t, (5.1) 

see [3J|7]. So that a comparison of solutions to (11.61) and (I5.1[) can further be discussed. 

Matrix rank optimization problem is really a fruitful research field in both matrix analysis and optimiza- 
tion theory. In recent years, many numerical methods were developed for matrix rank minimization problems 
based on approximation and iteration methods. However, there is no evidence that these numerical methods 
can make the matrix-rank-objective functions really attain their minimal values. Because the exact extremal 
ranks of A + BXC can be calculated by the analytical formulas in this note, they will set a principle for 
verifying the correctness and effectiveness of these numerical methods. 



References 

[1] B. De Moor and G.H. Golub, The restricted singular value decomposition: properties and applications. SIAM 

J. Matrix Anal. Appl. 12(1991), 401-425. 
[2] C. Eckart and G. Young, The approximation of one matrix by another of lower rank. Psychometrika 19(1936), 

211-218. 

[3] S. Friedland and A. Torokhti, Generalized rank- constrained matrix approximations. SIAM J. Matrix Anal. 
Appl. 29(2007), 656-659. 

[4] Y. Liu and Y. Tian, How to use RSVD to solve the matrix equation A = BXC. Linear Multilinear Algebra 
58(2010), 537-543. 

[5] S. Ma, D. Goldfarb, L. Chen, Fixed point and Bregman iterative methods for matrix rank minimization, Math. 

Program. Ser. A 128(2011), 321-353. 
[6] E. Schmidt, Zur Theorie der linearen und nonlinearen Integralgleichungen. Math. Ann. 63(1907), 433-476. 
[7] D. Sondermann, Best approximate solutions to ma- trix equations under rank restrictions. Statistical Papers 

27(1986), 57-66. 

[8] Y. Tian, The maximal and minimal ranks of some expressions of generalized inverses of matrices. Southeast 

Asian Bull. Math. 25(2002), 745-755. 
[9] Y. Tian and S. Cheng, The maximal and minimal ranks of A — BXC with applications. New York J. Math. 

9(2003), 345-362. 

[10] H. Zha, The restricted singular value decomposition of matrix triplets. SIAM. J. Matrix. Anal. Appl. 12(1991), 
172-194. 

[11] H. Zha, A numerical algorithm for computing the restricted singular value decomposition of matrix triplets. 
Linear Algebra Appl. 168(1992), 1-25. 



11 



